The Reliability Of Anaphoric Annotation, Reconsidered: Taking Ambiguity Into Account
نویسندگان
چکیده
We report the results of a study of the reliability of anaphoric annotation which (i) involved a substantial number of naive subjects, (ii) used Krippendorff’s α instead of K to measure agreement, as recently proposed by Passonneau, and (iii) allowed annotators to mark anaphoric expressions as ambiguous.
منابع مشابه
Influence of Text Type and Text Length on Anaphoric Annotation
We report the results of a study that investigates the agreement of anaphoric annotations. The study focuses on the influence of the factors text length and text type on a corpus of scientific articles and newspaper texts. In order to measure inter-annotator agreement we compare existing approaches and we propose to measure each step of the annotation process separately instead of measuring the...
متن کاملAnaphoric Annotation of Wikipedia and Blogs in the Live Memories Corpus
The Live Memories corpus is an Italian corpus annotated for anaphoric relations. The corpus includes manual annotated information about morphosyntactic agreement, anaphoricity, and semantic class of the NPs. For the annotation of the anaphoric links the corpus takes into account specific phenomena of the Italian language like incorporated clitics and phonetically non realized pronouns. The Live...
متن کاملImproved Knight Method Based on Narrowed Search Space for Instantaneous GPS Attitude Determination
The Knight algorithm can instantaneously resolve integer ambiguities and improve significantly the search speed by skipping over most less-likely integer ambiguity candidates. However, its reliability relies on the volume of the integer ambiguity search space. Utilizing coarse attitude knowledge can reduce the size of the search space. This paper proposes a new method to narrow the search space...
متن کاملPoCoS - Potsdam Coreference Scheme
This document outlines minimal design principles underlying annotation of coreference relations in PoCoS, a scheme for cross-linguistic anaphoric annotation. We identify language-independent principles for markable identification which are essential for comparability of annotations produced for different languages. We further suggest a clear and motivated structure of annotation stages, the sep...
متن کاملGenerating Anaphoric Expressions: Pronoun Or Definite Description?
In order to produce coherent text. natural language generation systems must have the ability to generate pronouns in the appropriate places. In the past, pronoun usage was primarily investigated with respect to the accessibility of referents. We.argue that generating appropriate referring expressions requires looking at factors beyond accessibility. Also important are sentence boundaries, dista...
متن کامل